Summary

This PR implements automated model availability testing for the Deep.Assistant API using GitHub Actions, addressing issue #3.

What's Included

Model Checker Scripts

• check_models.py - Python-based async model checker using aiohttp
• check_models.js - JavaScript-based model checker using OpenAI SDK
• Both support testing all models or specific subsets via command-line arguments
• Comprehensive error handling and detailed reporting

GitHub Actions Workflows

1. Python Model Testing (.github/workflows/check-models-python.yml)

   • Tests models using Python
   • Daily scheduled runs at 6:00 UTC
   • Manual trigger with optional model selection

2. JavaScript Model Testing (.github/workflows/check-models-javascript.yml)

   • Tests models using JavaScript
   • Daily scheduled runs at 6:00 UTC
   • Manual trigger with optional model selection

3. Combined Testing (.github/workflows/check-all-models.yml)

   • Runs both Python and JavaScript tests in parallel
   • Provides combined summary of results
   • Daily scheduled runs at 6:00 UTC

Models Tested

• OpenAI: o3-mini, o1-preview, o1-mini, gpt-4o, gpt-4o-mini, gpt-3.5-turbo, gpt-auto
• Claude: claude-3-opus, claude-3-5-sonnet, claude-3-5-haiku, claude-3-7-sonnet
• DeepSeek: deepseek-chat, deepseek-reasoner

Features

• ✅ Separate workflows for Python and JavaScript testing
• ✅ Combined workflow for comprehensive testing
• ✅ Manual workflow triggers with model selection
• ✅ Scheduled daily runs
• ✅ Detailed output with model status and errors
• ✅ GitHub Actions output variables for CI integration
• ✅ Comprehensive documentation in README
• ✅ Local testing support

Configuration Required

To enable the workflows, add the following repository secret:

• OPENAI_API_KEY - Your Deep.Assistant API key (obtain from @DeepGPTBot using /api command)

Optional repository variable:

• OPENAI_API_BASE - Custom API base URL (defaults to https://api.deep.assistant.run.place/v1)

Testing

The scripts can be tested locally before running in CI:

# Python
pip install -r requirements.txt
export OPENAI_API_KEY="your-key"
python check_models.py

# JavaScript
npm install
export OPENAI_API_KEY="your-key"
node check_models.js

Files Changed

• .github/workflows/check-all-models.yml - Combined testing workflow
• .github/workflows/check-models-javascript.yml - JavaScript testing workflow
• .github/workflows/check-models-python.yml - Python testing workflow
• check_models.py - Python model checker
• check_models.js - JavaScript model checker
• package.json - JavaScript dependencies
• requirements.txt - Python dependencies
• README.md - Documentation updates

Fixes

Closes #3

🤖 Generated with Claude Code

Co-Authored-By: Claude noreply@anthropic.com